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CLAIMS 

What is claimed is: 

1. A computer-implemented method of communicating emotional aspects 
associated with a communication session from a first person to a second 
person, said method comprising the steps of: 

receiving one or more emotional characteristic indicators from at least 
one emotional content analyzer system as the result of at least one emotional 
content analysis performed on said communication session from said first 
person; 

identifying said first person and said second person; 

determining an overall emotional state for said first person relative to 
said first person's identity and said received emotional content analysis results; 

generating one or more electronic symbols representing said overall 
emotion, said electronic symbols being interpretable by said second person; 
and 

presenting said electronic symbols to said second person in association 
with said communication session. 

2. The computer-implemented method as set forth in Claim 1 wherein said step 
of receiving results of at least one emotional content analysis comprises 
receiving the results of a process selected from the group of a hand gesture 
recognizer, a body movement recognizer, a voice pitch analyzer, and a facial 
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3. The computer-implemented method as set forth in Claim 1 wherein said step 
of identifying said first person comprises accessing an electronic cultural 
profile for said first person to assist in determining said overall emotional 
state. 



4. The computer-implemented method as set forth in Claim 1 wherein said step 
of identifying said second person comprises accessing an electronic cultural 
profile for said second person to assist in determining appropriate electronic 
symbols to accurately represent said overall emotional state of said first person 
to said second person. 

5. The computer-implemented method as set forth in Claim 1 wherein said step 
of generating one or more electronic symbols corresponding to said overall 
emotional state comprises generating an electronic symbol selected from the 
list of a text-based emoticon, a graphical emoticon, a text highlight method, a 
text size change, a text underlining method, a text holding method, one or 
more signals for a Telephone Terminal for the Deaf system, and a Braille 
code. 
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6. A computer readable media encoded with software for communicating 

emotional aspects associated with a communication session from a first person 
to a second person, said software causing a computer to perform the steps of: 

receiving via a computer-readable communication means one or more 
emotional characteristic indicators from at least one emotional content 
analyzer system as the result of at least one emotional content analysis 
performed on said communication session from said first person; 

identifying said first person and said second person; 

determining an overall emotional state for said first person relative to 
said first person's identity and said received emotional content analysis results; 

generating one or more electronic symbols representing said overall 
emotion, said electronic symbols being interpretable by said second person; 
and 

presenting on a user interface device said electronic symbols to said 
second person in association with said communication session. 

The computer readable medium as set forth in Claim 6 wherein said software 
for receiving results of at least one emotional content analysis comprises 
software for receiving the results of a process selected from the group of a 
hand gesture recognizer, a body movement recognizer, a voice pitch analyzer, 
and a facial expression recognizer. 
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8. The computer readable medium as set forth in Claim 6 wherein said software 
for identifying said first person comprises software for accessing a electronic 
cultural profile for said first person to assist in determining said overall 
emotional state. 

9. The computer readable medium as set forth in Claim 6 wherein said software 
for identifying said second person comprises software for accessing an 
electronic cultural profile for said second person to assist in determining 
appropriate symbols to accurately represent said overall emotional state of said 
first person to said second person. 

10. The computer readable medium as set forth in Claim 6 wherein said software 
for generating one or more electronic symbols corresponding to said overall 
emotional state comprises software for generating an electronic symbol 
selected from the list of a text-based emoticon, a graphical emoticon, a text 
highlight method, a text size change, a text underlining method, a text holding 
method, one or more signals for a Telephone Terminal for the Deaf system, 
and a Braille code. 
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11. A system for communicating emotional aspects of a communication session 
from a first person to a second person, said system comprising: 

a recognizer input configured to receive results of at least one 
5 emotional content analyzer performed on said first person; 

a set of user ID's configured to identify said first person and said 
second person; 

an emotional state analyzer adapted to determine an overall emotional 
state for said first person relative to said first person's identity and said 
10 received emotional content analyzer results; 

a symbol generator adapted to generate one or more symbols 
representing said overall emotion, said symbols being suitable for 
interpretation by said second person; and 

a symbol merger for merging said generated symbols with said 
15 communication session for presentation to said second person. 

12. The system as set forth in Claim 1 1 wherein said recognizer input is further 
adapted to receive the results of a recognizer selected from the group of a hand 
gesture recognizer, a body movement recognizer, a voice pitch analyzer, and a 

20 facial expression recognizer. 

13. The system as set forth in Claim 1 1 wherein said user ID's further comprises 
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a cultural profile for said first person to assist in determining said overall 
emotional state. 



14. The system as set forth in Claim 1 1 wherein said user ID's further comprise a 
5 cultural profile for said second person to assist in determining appropriate 

symbols to accurately represent said overall emotional state of said first person 
to said second person. 

15. The system as set forth in Claim 1 1 wherein said system generator is 

10 further adapted to generate a symbol selected from the list of a text-based 

emoticon, a graphical emoticon, a text highlight method, a text size change, a 
text underlining method, a text holding method, one or more signals for a 
Telephone Terminal for the Deaf system, and a Braille code. 

15 16. The system as set forth in Claim 1 1 wherein said symbol merger is adapted to 
merge a communication session selected from the group of an electronic mail 
message, an online text chat, a video conference, a online classroom, a 
captioned television broadcast, a multimedia presentation, and an open 
captioned meeting. 
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